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Abstract 

Background: Psycliosocial problems are more prevalent among patients with chronic diseases than among the 
general population. They may lead to a downward spiral of poor adherence, deterioration of the condition and decline 
in daily functioning. In addition to medical management, systematic attention to emotional and role management 
tasks during routine chronic care seems mandatory. We intend to integrate an existing nurse-led minimal 
psychological intervention to support patients' self-management, which appeared to be effective and cost-effective, in 
routine care by primary care nurses, so we adjusted it to fit the host setting. The resulting Self-Management Support 
(SMS) programme involves early detection of patients with emotional distress and problems of daily functioning, as 
well as self-management support through problem solving and reattribution techniques. Strategies to embed SMS in 
daily practice include training and booster sessions for practice nurses as well as organisational and financial 
arrangements. This study aims to simultaneously evaluate the implementation process and effects of SMS in routine 
care, using a hybrid effectiveness-implementation design. 

Methods/Design: Registration data, questionnaires and interviews will be used to explore the facilitators, barriers and 
costs regarding successful implementation of SMS. The effects of SMS will be evaluated in a pragmatic cluster- 
randomised controlled trial with a baseline measurement and follow-up measurements after 4 and 12 months. The 
population will consist of 46 practice nurses and their type 2 diabetes patients (N = 460; 1 0 per practice nurse). The 
practice nurses will be randomly assigned to the intervention or control group. Practice nurses of the intervention 
group will receive SMS training. Patients for the intervention and control groups will be recruited by a researcher-led 
self-administered screening procedure to decide which patients of those scheduled for routine consultation are likely 
to be detected by the practice nurses as eligible for the self-management support. Primary outcome measure is 
patients' daily functioning. Secondary measures include emotional well-being, participation, autonomy and control over 
the disease. 
(Continued on next page) 
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Discussion: Our hybrid study design is complicated by the detection nnethod used by the practice nurses. This nnethod 
is an innplennentation issue in itself that has consequences for the realisation and power of the effect evaluation. 

Trial registration: Current Controlled Trials, NTR2764 

Keywords: Hybrid Effectiveness-lnnplementation Design, Primary Care, Chronic Disease, Psychosocial Problems, 
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Background 

The prevalence rate of psychosocial problems is higher 
among patients with chronic somatic diseases than among 
the general population [1-4], Problems like depression or 
distress may hamper the ability to manage a chronic con- 
dition [5]. A reciprocal relationship has been suggested: 
emotional distress may interfere with control over the dis- 
ease, and at the same time, poor control over the disease 
can lead to emotional distress. Persistent negative feelings 
have implications for adherence to medication and lifestyle 
regiments, motivation, self-efficacy and problem solving 
[6,7]. Patients therefore face not only the day-to-day med- 
ical management, but also the challenge to deal with their 
emotions and problems of daily functioning in order to re- 
main in control of their illness [6,8]. To improve the out- 
comes of chronic care, Lorig and Holman argue that three 
self-management tasks should be addressed in primary 
care: medical management, emotional management and 
role management [8]. However, Dutch guidelines for the 
care of chronic diseases like type 2 diabetes mellitus pri- 
marily focus on medical and lifestyle management [9,10]. 
This seems too narrow a focus, as there is also room for 
improvement in the detection and treatment of emotional 
problems in the chronically ill [4,11,12]. 

Our study intends to facilitate a shift towards a chronic 
care approach that combines attention to both biomedical 
and psychosocial aspects. We believe that equipping prac- 
tice nurses (PNs) with the ability to provide this might be 
an effective way to realise such a biopsychosocial approach 
in chronic care [13]. PNs in the Dutch primary care set- 
ting see patients on a regular basis, as they have the task 
of providing routine check-ups [14]. Since diabetes pa- 
tients were the first to be cared for by PNs, we aim to 
integrate an existing nurse-led minimal psychological 
intervention (MPI) in the diabetes follow-up care by PNs. 
The nurse-led MPI has proved to be effective in supporting 
the self-management skills of diabetes and COPD patients 
with minor to moderate depression [15-18]. 

The MPI can only be adopted by PNs if a detection 
method is added that enables PNs to distinguish between 
patients who are active self-managers, patients who would 
benefit from the psychosocial support, and patients who 
need more specialised psychosocial diagnostics or treat- 
ment. We call the resulting stepped approach to detec- 
tion and treatment 'Self-Management Support' (SMS). 



In addition to adapting the MPI to become SMS, we need 
to arrange for a training course with booster sessions, and 
ensure the allocation of time and organisational support 
to enable the PNs to adopt SMS in their current practice. 
For a thorough understanding of the effectiveness of SMS, 
the facilitators and barriers to its implementation in 
routine care need to be taken into account. Therefore, 
we want to start a hybrid effectiveness-implementation 
trial to examine the effectiveness of SMS in terms of pa- 
tient outcomes, and focus on implementation outcomes. 

Aim 

The aim of our study is to evaluate the process and effect- 
iveness of SMS implemented as an integral part of the 
care for patients with type 2 diabetes mellitus provided 
by PNs. We will simultaneously address the following 
research questions: 

1. What is the uptake of the SMS programme by the 
practice nurses, and what barriers hamper the 
implementation of SMS in routine primary care? 
(Study of the implementation strategies for SMS.) 

2. What is the effectiveness of SMS in terms of daily 
functioning, emotional health status, social 
participation, self-management behaviour, and 
health care use by patients with type 2 diabetes? 
(Study of the SMS clinical intervention.) 

The effectiveness of SMS (question 2) will be considered 
while taking the barriers to the implementation process 
(question 1) into account. 

Methods/Design 

In our study, we will use a hybrid effectiveness- 
implementation design to focus on implementation issues 
and the effectiveness of SMS at the same time. Curran 
and colleagues have presented a continuum of three 
types of such hybrid effectiveness- implementation (E-I) 
study designs [19], ranging from effectiveness research 
with minimal implementation strategies (type 1) to de- 
signs where effectiveness and implementation are equally 
balanced (type 2) and an implementation approach with 
minimal focus on effectiveness outcomes (type 3). We will 
examine the effects of SMS on patient outcomes and 
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simultaneously focus on implementation outcomes, hence 
it is a type 2 hybrid E-I study design. 

Below, we first describe our implementation strategies 
(intervention) and then explain our evaluation methods 
regarding the implementation and effects of SMS in rou- 
tine care (evaluation). 

Intervention 

In a previous study, the nurse-led minimal psychological 
intervention (MPI) was carried out by trained research 
nurses [20]. In our present study, practice nurses who 
provide diabetes care will have to adopt the MPI in their 
current practice. This required changes with regard to the 
clinical intervention as well as the organisational context 
in which the intervention will be integrated [21]. This sec- 
tion explains the steps that will be taken to implement the 
resulting SMS in routine diabetes care. 

Implementation strategy 1: adaptation of clinical intervention 

The nurse-led MPI has been altered from a 'research 
object' to an intervention that can be systematically em- 
bedded in routine primary care. Adaptations were needed 
regarding the target group, providers, detection of eligible 
patients and self-management support. The shift from 
MPI to SMS is summarised in Table 1. 

Target group The original effective nurse-led MPI was 
provided specifically to patients with a diagnosis of de- 
pression, whereas a wide range of psychological and social 
problems occur in a routine primary care setting. What 
primarily matters in daily practice is to what extent pa- 
tients experience problems of daily functioning [12]. SMS 
was therefore designed for chronic patients who encoun- 
ter problems of daily functioning and emotional distress. 

Providers Instead of research nurses providing the inter- 
vention as an add-on to usual care, SMS will be integrated 
in usual care provided by PNs. PNs work in general prac- 
tice under supervision of a GP. They see type 2 diabetes 
patients every 3 months for a diabetes check-up. SMS is 
to become an integral part of these check-ups. 

Table 1 The SMS approach contrasted with the original MPI 

MPI 



Detection procedure The diagnostic procedure that was 
used to recruit patients for the study to evaluate the ori- 
ginal MPI is not feasible in routine primary care: it was 
limited to depression, and included an extensive and 
time-consuming diagnostic interview (the Mini Inter- 
national Neuropsychiatry Interview) to confirm a diag- 
nosis of depression according to psychiatric criteria. For 
SMS, PNs will have to decide during routine diabetes 
check-ups whether watchful waiting, offering psycho- 
social self-management support or a referral to the GP 
because of symptoms of mental health problems is most 
appropriate. Therefore, we have introduced a stepped 
approach that allows interventions not sooner or more 
intense than necessary and not later or less intense than 
required. The approach is as follows. During each regu- 
lar diabetes check-up, PNs will explore whether the pa- 
tient is experiencing problems in daily life. Then they 
verbally administer the 'Daily Functioning Thermometer' 
(DFT), a visual analogue scale to rate the overall burden 
of diabetes. (See the Measurements section below for 
more information about the instruments.) Practice nurses 
will also verbally administer the 3-item Distress Screener 
(DS), a quick-scan instrument for emotional distress 
and an indicator of potential underlying severe mental 
health problems [22]. Patients with DS > 3 will be asked 
to complete the Four-Dimensional Symptom Question- 
naire (4DSQ) [23] immediately after the consultation. 
This self-report measure is widely used in Dutch primary 
care to distinguish non-specific general distress from 
depression, anxiety and somatisation. Scoring the 50 items 
of the 4DSQ should tal<e 5-10 minutes The completed 
4DSQ will be returned to the PN, who will score the 
4DSQ using a scoring form. Patients scores on the 4DSQ 
will distinguish between mild, moderate and severe mental 
health problems. Patients who experience problems of 
daily functioning (DFT > 4) and emotional health prob- 
lems (DS > 3 combined with moderate scores on subscales 
of the 4DSQ) will receive self-management support from 
the PN. If a patient has only mild' scores on the 4DSQ, 
the PNs will opt for watchful waiting. The same option will 
be used for patients with moderate scores on the 4DSQ 
who do not report problems of daily functioning due to 



SMS 

Chronic patients witli emotional distress and 
problems of daily functioning 

Practice nurses providing usual chronic care 

As part of daily care. Using simple tools, 
following a stepped care approach that fits 
the primary care setting 

1. problem solving 

2. cognitive therapy (reattribution) 



Target group Chronic patients with mild or non-severe 

major depression 

Providers Research nurses not involved in usual care 

Diagnostic approach For research purposes. Using an extensive diagnostic 

interview, following strict psychiatric criteria 

Self-management support intervention 1 . cognitive therapy (reattribution) 

2. problem solving 
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diabetes (DFT<4). These patients will be informed by 
telephone that there is as yet no indication for extra con- 
sultations. Patients with a severe' score on at least one of 
the subscales will be referred to the GP. The detection 
protocol is summarised in Table 2. 

Self-management support programme The self- 
management support by the PN will be provided during 
extra 20-minutes consultations. Its aim is to teach patients 
to take responsibility for the day-to-day management of 
their diabetes and its consequences. This self-management 
support is based on the MPI. The intervention strategy has 
been derived from principles of learning theory and has 
been described elsewhere [24]. PNs will help patients to 
define problems and solutions themselves, applying the 
techniques of problem-solving and reattribution. Problem- 
solving consists of 7 stages that efficiently address psycho- 
social problems and their possible solutions [25]. It starts by 
creating a link between emotional symptoms and problems, 
and explaining the rationale of the treatment: resolution 
of the problems may lead to resolution of the symptoms 
(step 1). 

Step 2 involves clarif)^ing and defining the problem. The 
third step is to set achievable goals. Once an achievable 
goal has been set, the patient will be asked to brainstorm 
about all potential solutions (step 4). Step 5 involves 
considering the pros and cons and selecting a preferred 
solution. In step 6, the solution will be implemented in 
daily life, and step 7 involves evaluating the progress. The 
problem-solving approach can easily be understood by pa- 
tients and can also easily be taught to practice nurses [25] . 
Patients with strong emotional involvement will be sup- 
ported using the reattribution technique. This starts by 
exploring and defining the patients problem, after which 
the patient is challenged to link cognitions to behaviour. 
To this end, patients may keep a diary to record thoughts, 
behaviours and related feelings. After possibilities to alter 
specific behaviours have been explored, an action plan will 
be formulated indicating how the goals can be achieved 
[20]. If specific problems appear to be persistent and ser- 
ious over time, action will be undertaken to provide more 
specialised care. PNs are instructed to refer these patients 



to the GP. 




Table 2 Detection protocol 




DFT<4 


DFT>4 


DS < 3 No indication 


Watchful waiting 


DS > 3 On the basis of the 4DSQ: 


On the basis of the 4DSQ: 


Mild: watchful waiting 


Mild: watchful waiting 


Moderate: watchful waiting 


Moderate: self-management 
support by PN 


Severe: referral to GP 


Severe: referral to GP 



In the original MPI, the cognitive approach appeared to 
benefit more highly educated patients more than lower 
educated ones [18]. The SMS will be implemented in a re- 
gion in the south of the Netherlands that is characterised 
by relatively low socio-economic status [26], so in order to 
increase the benefit for patients with low socio-economic 
status, we will put greater emphasis on the problem- 
solving technique during the training of PNs. 

A flowchart of SMS is presented in Figure 1. 

Implementation strategy 2: involvement of regional GP 
organisation 

SMS will be implemented in one region in the south of 
the Netherlands. A group of 77 general practices (103 GPs) 
in the region, who collaborate in a GP organisation, was 
involved from the beginning of the SMS project, and 
they have prioritised the integration of SMS in the care 
for type 2 diabetes patients. The GPs are responsible for 
about 16,000 patients with type 2 diabetes mellitus. The 
region is characterised by relatively low socio-economic 
status, health status and life expectancy and substantial 
ageing of the population [26,27]. Based on earlier research 
findings we estimate that as many as 2400 patients 
with type 2 diabetes mellitus (15%) may suffer from 
emotional distress accompanied by problems of daily 
functioning [28]. 

Implementation strategy 3: financial support 

The reimbursement of diabetes care in the Netherlands 
is regulated by means of diagnosis-treatment combina- 
tions (DTC), a Dutch variant of the Diagnosis Related 
Groups [29]. For each care group, health insurers' purchase 
integrated care by negotiating a fixed price per patient per 
year. The elements of care with corresponding tariffs are 
defined in a shared care protocol. This is driven by the 
Dutch care standard' for diabetes [9], which is based on 
existing guidelines, protocols and performance indicators. 
During the study, a health insurance company will reim- 
burse the extra time spent on SMS by practice nurses and 
GPs. The reimbursement will be integrated in the DTC for 
diabetes care. 

Implementation strategy 4: training 

The PNs in the intervention group will be trained to carry 
out SMS in three 8 -hour training sessions. The training 
programme is based on a nurses' training course that has 
been shown to be feasible, attractive and successfiil. PNs 
learn how to help patients identify their problems and set 
achievable goals [24]. The training programme will also 
focus on exploration skills. PNs will learn to use instru- 
ments to establish the severity of psychosocial problems 
in a stepped approach (first DFT and DS, and if appro- 
priate further exploration using 4DSQ). The training ses- 
sions will take place in small groups, to facilitate active 
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Consultation 
by phone 

Referral to GP 




Problem Solving 

1 . Explanation of treatment and 
its rationale, formulation of 
problem list 

2. Clarification and definition 
of problem 

3. Setting achievable goals 

4. Generating solutions 

5. Choice of preferred solution 

6. Implementation of the 
preferred solution 

7. Evaluation 



Reattribution 

1 . Problem definition 

2. Linking cognitions to behaviour, 
(optional) by keeping a diary 

3. Action plan 



Extra consultation(s) 



Figure 1 Flowchart for SMS intervention. 



participation of the PNs, for example by role-play. These 
three training sessions will be followed up by booster ses- 
sions and telephone consultations, whose frequency will 
depend on the PNs' needs. Booster sessions will be used to 
maintain and improve the PNs' SMS skills. PNs will make 
audiotapes during consultations, which will be reflected on 
during booster sessions. 

Implementation strategy 5: registration system for SMS 

SMS wfll be integrated in the registration system that 
GPs and PNs use for diabetes care. The steps to be taken 
during the detection phase of SMS as weU as the differ- 
ent stages of the self-management support by the PN are 
displayed in the regular registration system. PNs will rec- 
ord how patients rate their burden of diabetes (DFT), as 
well as their scores on the distress screener (DS). This in- 
formation will be displayed at the next diabetes check-up. 



The system also helps PNs compute the outcomes of 
the 50-item Four-Dimensional Symptom Questionnaire 
(4DSQ). The PNs will also record the self-management 
support steps that are taken during each consultation, 
and the patients' action plans. 

Evaluation of the implementation process 
Design 

A process evaluation wiU be done to analyse the facilita- 
tors and barriers regarding integration of SMS in routine 
care. We will gather quantitative and qualitative data 
about the intervention as an integral part of the routine 
diabetes care, as weU as about the health professionals 
(PNs and GPs) and patients, and the impact of SMS on 
the practice organisation and the community [30]. How 
SMS has been implemented and received by the par- 
ticipants will be measured by means of the following 
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concepts, as recommended by Saunders and colleagues 
[31]: fidelity, dose delivered, dose received, reach, recruit- 
ment and context. In addition, the costs of implementing 
SMS in routine care will be assessed. The process evalu- 
ation will include formative evaluation with respect to the 
new components of the clinical intervention, as these as- 
pects may need to be refined or optimised to make them 
fit the local setting. 

Variables and measurements 

Fidelity refers to the extent to which SMS has been 
implemented as planned. At each diabetes consultation, 
the PNs will record which steps of the SMS protocol 
have been carried out. The outcomes on the DS, DFT 
and 4DSQ, the choices that have been made regarding 
further treatment and the patients' action plans will also 
be recorded. The registration system also offers room 
for comments. PNs will be asked to give an explanation 
if they deviate from the SMS protocol. 

Dose delivered is measured as the number of compo- 
nents of SMS per patient that have been carried out as 
intended. Data will be derived from the registration system. 

Dose received includes two components: satisfaction 
and exposure. 

Exposure refers to the extent to which participants 
(patients and health professionals) are actively engaged 
with the SMS programme and use the tools of SMS in 
daily practice. Engagement and satisfaction of partici- 
pants will be measured among the providers (PNs and 
GPs) and among the patients. 

PNs will be asked to complete an evaluation form after 
the training sessions, with questions about the clarity of 
wording of the components of the training course. With 
regard to the integration of SMS in routine diabetes 
consultations, issues discussed with PNs during booster 
sessions will be recorded during the follow-up period. 
This will provide qualitative information about the bar- 
riers and facilitators that PNs may experience. At the end 
of the follow-up period (one year after the SMS training 
course), we will develop a questionnaire including all the 
barriers and facilitators that have been discussed during 
the booster sessions. PNs will be asked to individually rate 
all these issues. 

The engagement and satisfaction of GPs will be evalu- 
ated by means of self- administered questionnaires. All par- 
ticipating GPs from the intervention arm will be asked 
about their involvement in the SMS programme and their 
views on the impact of SMS for their practice. 

How patients experience being involved in the SMS 
programme will be explored in detail by holding semi- 
structured interviews with a purposive sample of pa- 
tients who have received the SMS from their PN. These 
interviews will be held during the follow-up period. The 
topics include patients' experiences with the detection 



phase of SMS, the self-management support, the oppor- 
tunities for and barriers to the implementation of their 
action plans in daily life, and their suggestions for im- 
provement of the SMS. Interviews with patients will be 
audio-taped and transcribed verbatim. 

Recruitment refers to the way we have approached and 
invited the PNs and GPs to become involved in the pro- 
ject to implement and evaluate SMS. 

Reach refers to the participation rate and will be mea- 
sured as the number of GPs and PNs who actually 
participated. 

Context refers to the factors relating to the practice, 
the community, the social/political context, or other 
situational issues that affect either the implementation 
of SMS or its outcomes. To examine context issues in 
terms of the implementation and effect of SMS, we will 
draw up the minutes of meetings with the regional care 
group of general practitioners, the health insurer and 
our research team. 



Cost evaluation 

We will measure the direct costs of SMS. In addition to 
the training and booster sessions, these will include the 
time to integrate SMS in routine diabetes consultations. 
PNs will record the time they spend on each stage of the 
stepped SMS approach. 

Data analysis 

Data of the implementation study will be analysed by 
means of descriptive statistics. 

The qualitative interviews with patients will be analysed 
by interpretative phenomenological analysis, a framework 
that can be used to develop in-depth descriptions of 
patients' experiences. The purpose is to explore the pa- 
tients' perceptions of what is important in relation to 
SMS. We will abstract themes and cluster them for each 
case [32]. Abstracting and clustering of the themes will be 
done independently by two researchers. 

Clinical effect evaluation 
Design 

The effect evaluation of SMS involves a pragmatic 2-armed 
cluster-randomised controlled trial (cluster-RCT) with PNs 
as the unit of randomisation. Allocation concealment will 
be achieved by having an independent experienced re- 
search assistant perform a blockwise randomisation using 
a random number seed computer program. PNs (n = 46) 
will be assigned to an intervention group or control group 
at an allocation ratio of 1:1, after stratification into PNs 
working alone in a practice, PNs working in a team and 
PNs working in different practices. PNs working in the 
same general practice will be randomised to the same 
trial arm. 



van Dijk- de Vries et al. BMC Family Practice 2013, 14:77 
http://www.bionnedcentral.conn/1471-2296/14/77 



Page 7 of 1 3 



PNs in the intervention arm will be trained to apply SMS 
in addition to the usual care, which consists of 3-monthly 
diabetes check-ups according to the current guidelines 
[10]. PNs in the control arm will be instructed to provide 
usual care. 

Patients with emotional distress and problems of daily 
functioning will be included in the effect evaluation. To 
maintain the balance between the intervention and con- 
trol groups, a screening procedure will be carried out by 
the research centre. A self-administered postal question- 
naire will be used to detect eligible patients. 

Approval for this study has been obtained from the 
Medical Ethics Committee of Maastricht University/ 
University Hospital Maastricht. 

Sample size calculation 

Assuming an alpha of 0.05 and a beta of 0.90, an im- 
provement in perceived daily functioning (defined as a 
score less than or equal to 4 on the Daily Functioning 
Thermometer (DFT), our primary outcome) at T12 oc- 
curring in 20% of the patients in the intervention group 
versus 5% of those in the control group requires at least 
a net number of 116 patients per arm (N = 232; 5 patients 
per practice nurse). It will be necessary to take account of 
a possible dependence between observations on patients 
of the same practice nurse. The intra-class correlation 
coefficient (ICC) is assumed to be 0.04, a median value 
for cluster-RCTs in the primary care setting [33]. Assum- 
ing a 30% loss to follow-up [17] we need to recruit at least 
331 patients (8 per PN). Since participation in the screen- 
ing procedure will not necessarily mean that patients also 
give informed consent for the effect evaluation, 10 con- 
secutive patients for each PN will be invited to participate 
in the effect evaluation (N = 460). 

Patient recruitment 

All patients with a clinically established diagnosis of type 
2 diabetes mellitus who are able to read and write Dutch 
will be sent a letter by their GP, explaining SMS and 
asking for informed consent to participate. Patients will 
receive this letter six weeks before a planned diabetes 
consultation with their PN. The enclosed screening 
questionnaire will contain the same instruments that PNs 
in the intervention group are going to use to detect 
whether patients are eligible for the self-management 
support, i.e. the 'Daily Functioning Thermometer' (DFT) 
and the 3-item Distress Screener (DS) [22]. For more in- 
formation about these instruments, see the section on 
Measurements below. Patients will be asked to return the 
completed questionnaire to the research centre and give 
informed consent for their data to be used for recruitment 
if they are found to be at risk. For each practice nurse, 10 
consecutive patients with scores of DFT >4 and DS >3 will 
be asked to participate in the study and to give informed 



consent for the follow-up measurements. To prevent 
bias, PNs will not be notified about the outcomes of the 
recruitment procedure. 
A flowchart of the trial is shown in Figure 2. 

Measurements 

To assess the effectiveness of SMS, follow-up measure- 
ments will be carried out at baseline and 4 and 12 months 
after inclusion. Table 3 provides an overview of the mea- 
sures of the effect evaluation and the times of assessment. 

Background variables Patient variables that will be 
reported are sex, age, year of diagnosis, treatment of dia- 
betes (insulin therapy or tablets), marital status and educa- 
tion. Furthermore, we will record the age of the PNs, the 
number of PNs for diabetes management working in a 
general practice, as well as the educational background of 
the PNs. 

Primary outcome measure The primary outcome will 
be daily functioning as measured by means of the Daily 
Functioning Thermometer (DFT). This is a visual analogue 
scale (VAS) on which patients can rate the overall bur- 
den of diabetes on their daily functioning by indicating 
a position along a continuous vertical 100 mm line be- 
tween 0 ('no burden at alF) and 10 ('extreme burden'). 
The VAS score is determined by measuring the distance 
to the point marked by the patient, in millimetres. The 
DFT is comparable to the Distress Thermometer (DT), 
an easily understood, valid and feasible self-report meas- 
ure of distress used among various groups of cancer 
patients [34]. A cut-off score of 4 has been chosen to 
differentiate between patients who could benefit from 
self-management support by the PN (DFT > 4) and pa- 
tients who have apparently found a satisfactory way to 
live with the consequences of their diabetes (DFT < 4). 
A pilot study among 7 patients with type 2 diabetes 
mellitus confirmed the face validity of the DFT. 

Secondary outcome measures Three instruments will 
assess patients' emotional health status. 

Diabetes-related emotional distress will be measured 
by means of the Problem Areas in Diabetes questionnaire 
(PAID). This 20-item scale (with five-point Likert scales) 
describes common problematic situations for diabetes 
patients, each representing a unique area of diabetes- 
specific emotional distress. The sum of the scores for 
the 20 items is multipUed by 1.25 to get a final score 
between 0 and 100. The Dutch PAID has good internal 
consistency and validity [35-37]. 

The Four-Dimensional Symptom Questionnaire (4DSQ) 
will be used to measure the presence and severity of men- 
tal health problems [23]. The levels of distress (16 items), 
depression (6 items), anxiety (12 items) and somatisation 
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Recruitment of 
general practices 



Randomisation PNs 



Control group 



Intervention group 



SMS Training + 
booster sessions, 
financial support, 
registration system 



Self-administered 
screening 
questionnaires 
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Figure 2 Flowchart for SMS trial. * DFT= Daily Functioning Tliermometer. DS = Distress Screener. 



(16 items) will be assessed The reference period is 'the 
past week'. The item scores are summated to obtain scale 
scores. The 4DSQ has been found to be a valid self-reported 
questionnaire in the primary care setting [23]. For a 
more qualitative evaluation of emotional problems that 
patients experience, we will use the Psychological Out- 
come Profiles (PSYCHLOPS). The PSYCHLOPS asks 
patients to describe and score their own emotional health 
problems. It is a validated patient-generated measure with 
pre-therapy, during-therapy and post-therapy versions. 
The instrument is intended to measure individual changes. 
It is responsive to change and is internally consistent [38]. 

Both PSYCHLOPS and 4DSQ explicitly expect patients 
to define and rate their emotional health problems. An 
increased awareness about their emotional problems of 
daily functioning could influence the issues discussed 
during the diabetes consultation, which could result in 
reduced contrast between the two groups. We will not 
use the 4DSQ and the PSYCHLOPS in the control 
group at TO, as the timing of the baseline measurement 



is just before a diabetes consultation, whereas the as- 
sessment at T4 is further removed from a diabetes con- 
sultation. Inclusion of the PSYCHLOPS and 4DSQ at 
both T4 and at the end of the follow-up period (T12) 
will provide insight into individual changes. In the inter- 
vention group, inclusion of the PSYCHLOPS at baseline 
will provide valuable information about the patients' 
individual emotional problems. The 4DSQ does not need 
to be included in the baseline measurement as it is already 
part of the SMS intervention. 

Quality of life, i.e. functional health and well-being from 
the patients point of view, will be measured by means 
of the 12-item Short-Form Health Survey (SF-12), a val- 
idated subset of the generic health status questionnaire 
SF-36 [39,40]. Data will be summarised in 2 scales: a 
physical component summary (PCS) and a mental com- 
ponent summary (MCS). 

Participation and autonomy will be measured by means 
of the Impact on Participation and Autonomy (IPA) 
questionnaire. The IPA has proved to be valid, reliable 



van Dijk- de Vries et al. BMC Family Practice 2013, 14:77 
http://www.bionnedcentral.conn/1471-2296/14/77 



Page 9 of 1 3 



Table 3 Effect evaluation: outcome measures and time of assessment 



Concept 



Measurement 



Items 



Moment in time 



3-monthly diabetes consultations TO T-4 T-12 
during follow-up 



Primary outcome 
Daily functioning 
Secondary outcomes 
Diabetes-related emotional distress 
Mental health problems 

Quality of life 

Participation and autonomy 
Job performance 
Self-management knowledge and behaviour PIH-NL 



DFT 
PAID 

PSYCHLOPS 
4DSQ 
SF-12 
I PA 

SF-HLQ 



General self-efficacy 
Control over the disease 

Health care use 
Covariates 

Patient demographics 



Practice nurse demographics 



GSES-12 

Average blood glucose 
level (HbAlc) 



Sex 

Age 

Year of diagnosis 
Treatment of diabetes 
Marital status 
Education 
Age 

Training 

Type of general practice(s) 

(one CP, two GPs, group, health centre) 



20 
9 

50 
12 

32 + 9 
5 

12 
12 
1 



1 Only patients in intervention arm. Risk of contamination. 

2 Only eligible patients (Distress Screener > 3). 
* = measuring moment. 



and responsive to change [41]. Thirty- two items (five- 
point Likert scales) cover five domains of participation: 
autonomy indoors', 'family role', autonomy outdoors', 
social life and relationships' and work and education'. 
A score for each subscale will be calculated. In addition, 
9 items will evaluate the extent to which limitations are 
experienced as problematic: no problems', minor prob- 
lems' or 'major problems'. These items will be scored sep- 
arately [42]. 

Five items from the Short-Form Health and Labour 
Questionnaire (SF-HLQ) will be used to measure difficulties 
of job performance due to health problems. The SF-HLQ is 
a generic and validated measurement to collect data about 
productivity loss relating to health problems [43]. 

Patients' self-management knowledge and behaviours 
regarding their diabetes will be measured by the Partners 
in Health (PIH) scale [44]. This scale reliably and validly 



measures aspects of patient progress within a self- 
management programme for a chronic condition. We will 
use the Dutch version (PIH-NL). The 12 items (0-8 Likert 
scales with 0 indicating high self-management and 8 low 
self-management) cover four domains of patients' compe- 
tency in relation to the self-management of their chronic 
condition (knowledge, coping, management of condition 
and adherence to treatment). 

The General Self-Efficacy Scale (GSES-12) will be used 
to assess the patients' belief in their ability to organise 
and engage in certain behaviours. The sum score of the 
12 items (five-point Likert scales) reflects an internally 
consistent and stable unidimensional construct of gen- 
eral self-efficacy [45,46]. 

At each diabetes consultation, the blood glucose level 
over the past 2 to 3 months (HbAlc) will be measured 
and recorded in the registration system. 
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The effect of SMS on patients' health care utilisation re- 
fers to individual numbers of visits to the general practice, 
specialist referrals and admissions, mental health care 
consultations, use of home care and hours of paid and un- 
paid household help. Patients will record their health care 
use retrospectively (over the last month) in the patient 
questionnaires administered at baseline and after 4 and 
12 months. Data about referrals to the GP, and the num- 
ber of contacts with the general practice will be collected 
from the GPs registration system. 

Data analysis of the effect evaluation 

The effectiveness of SMS will be assessed by intention- 
to-treat analyses. The comparability of patients in the 
intervention and control groups regarding baseline char- 
acteristics and demographics will be described and tested 
for significant differences (t- tests and Chi-square tests). 
The average changes in DFT score will be calculated, as 
well as the number of patients that have DFT <4 after 
receiving SMS (T4 and T12). Separate scores will be cal- 
culated for the subscales of the secondary outcome 
measures. Changes in the primary and secondary out- 
comes between the intervention and control groups will 
be analysed using multilevel analyses (linear and logistic 
regression methods) as this will account for intracluster 
correlation among PNs. Multivariate regression analyses 
will be used to adjust the results for co-variables such as 
patient characteristics (age, sex, socio-economic status) 
and PN characteristics (age, educational background). 

Discussion 

This paper describes a study protocol to implement and 
evaluate an evidence-based, nurse-led minimal psycho- 
logical intervention (MPI) in routine diabetes care in the 
Dutch primary care setting. The intervention itself has 
already been found to be an effective and cost-effective 
method to improve self-management by chronic patients 
with mild to moderate depression, but its effect was 
evaluated in a trial with standardised conditions regard- 
ing the inclusion of patients, and the care was delivered 
by research nurses [20]. Both GPs and a health insurer 
have prioritised the inclusion of the MPI in routine dia- 
betes care, so there was an 'implementation momentum' 
within the system [19]. Actually making this happen re- 
quired adaptations to be introduced regarding providers, 
target group and detection procedure. The new approach 
has been named Self-Management Support (SMS). 

Our hybrid design and its potential 

The effects of integrating SMS in the routine primary care 
setting can only be evaluated when it is implemented in 
the real world'; the implementation strategies will be de- 
cisive for the success of SMS at the practice and patient 
levels. The essential adjustments to the intervention with 



regard to both providers and recipients require further 
insights into the effectiveness of SMS. An understanding 
of both the prerequisites of integrating SMS in routine 
care and the effectiveness of SMS is essential for future 
planning. In terms of the continuum of design types pro- 
posed by Curran and colleagues [19], our study is an ex- 
ample of a type 2 hybrid effectiveness-implementation 
(E-I) study design. The effects and the implementation 
process will be evaluated simultaneously. 

Curran and colleagues [19] argue that the combination 
of two study designs in a hybrid study may have the po- 
tential to accelerate the translation of research into rou- 
tine practice. They refer to the dominant approach of 
translating research into practice that starts with clinical 
efficacy research, then clinical effectiveness research, and 
finally implementation research. The potential for rapid 
integration of research into practice is also apparent in 
our study. SMS evolved from a joint endeavour of the 
regional care organisation of general practitioners, the 
health insurer and the evaluators. The intervention has 
been developed as a generic approach to support patients' 
self-management. The outcomes of the implementation 
and evaluation of SMS will provide a broad perspective on 
barriers, facilitators and effects of the detection and treat- 
ment of psychosocial problems by PNs in chronic care. 
Hence, if SMS appears to be successfully implemented 
and has relevant effects, it could in the near future also be 
applied to patients with other chronic conditions. The 
shared vision of stakeholders regarding SMS and their 
involvement in the development and evaluation is expected 
to facilitate a rapid large-scale integration of SMS in 
routine care. 

Our hybrid design and its methodological challenges 

In hybrid E-I studies, the world of implementation science 
has to combine with the tradition and vocabulary of re- 
searchers from clinical research backgrounds. This implies 
a complex balance in the design itself between internal 
validity and factors associated with implementation, but 
also can be an obstacle to funding and publication [19,47]. 

Our study involves an additional methodological issue 
with respect to hybrid design, viz. the new detection 
method that is introduced in our study to integrate the 
original MPI in routine care. Its feasibility in routine dia- 
betes consultations is not yet known, and needs to be eval- 
uated as part of our process evaluation. However, an 
adequate detection method is also a prerequisite for clin- 
ical effectiveness of SMS. The methodological issues re- 
garding the detection method are further explained below. 

In order to integrate the MPI in the daily care by prac- 
tice nurses, we had to introduce a new detection method 
to fit the primary care setting. The MPI has been adapted 
to become a self-management intervention for patients 
with problems of daily functioning and emotional distress. 
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As there was no primary care instrument available to de- 
tect patients with these psychosocial problems, we have 
introduced new instruments in the form of the Distress 
Screener and the Daily Functioning Thermometer, and de- 
fined the cut-off criteria. The Distress Screener and the 
Daily Functioning Thermometer are assumed to be valid 
for the early detection of patients with emotional distress 
and problems of daily functioning [22,34]. These instru- 
ments will be integrated into the routine diabetes con- 
sultations provided by PNs. Our implementation strategies 
(i.e. providing training, financial support and a registration 
system) will determine whether PNs are able to integrate 
the instruments in their daily practice. Evaluation of the 
implementation process will show what numbers of pa- 
tients are detected, whether patients with problems of 
daily fiinctioning (according to the DFT) and with moderate 
psychological problems (according to the Four-Dimensional 
Symptom Questionnaire, 4DSQ) are representative of the 
group of patients that are in need of the self-management 
support, and to what extent PNs have the skills to inte- 
grate the tools in their routine consultations. The feasi- 
bility, power and success of our detection method are 
unknown and will determine the success and feasibility 
of the whole SMS approach. 

The detection method will an integral part of the tasks 
of the PNs during a routine diabetes consultation. PNs 
will be given a reasonable degree of freedom in applying 
the detection method in their consultations, as we use a 
pragmatic approach without strict internal controls. We 
aim to avoid interference of research activities with daily 
practice as much as possible, which has implications for 
the recruitment of patients for the effect evaluation. 

In theory, all diabetes patients of the PNs would be 
eligible for participation in the effect evaluation of SMS, 
as the PNs will apply the detection part of SMS in every 
diabetes consultation. However, we have chosen to limit 
the effect evaluation to patients with actual problems of 
daily functioning and emotional distress. This will in- 
crease the contrast between the intervention and control 
groups, so we need to include patients that are likely to 
be detected during regular care and receive further 
treatment. We had to set up a researcher-led parallel 
screening procedure to detect eligible patients from 
both the intervention and control groups. Based on our 
pragmatic approach, the conditions for this screening 
procedure are: 

1. The self-administered screening questionnaire is 
sent to the patient s home address and includes the 
instruments that PNs apply during consultation. 

2. The screening does not interfere with daily practice 
in the control arm. As the DFT and DS consist of 
simple and generic questions, we do not expect any 
interference with daily care. 



3. The time interval between the researcher-led 
screening and the nurse-led detection procedure 
needs to be limited. We have decided to send the 
screening questionnaire six weeks before the 
individual diabetes consultation appointment. 

However, we cannot avoid the risk that natural fluctua- 
tions in the emotional health status of patients will result 
in different outcomes on the DFT and DS in the nurse-led 
detection compared to the researcher-led postal screening. 
The time interval could become too long, for example if 
a consultation appointment is cancelled. We thus have 
to take into account that conclusions based on the 
researcher-led screening questionnaires will not always 
correspond to those of the same instruments appUed by 
the PNs during the consultations. As a consequence, a 
certain number of patients in our study sample will only 
be exposed to the detection part of SMS, without receiv- 
ing follow-up treatment, while some patients who are 
not included in the effect evaluation may receive the 
self-management support. This may reduce the contrast 
between the intervention and control arms. 

In conclusion, the strength of the clinical effectiveness 
evaluation in our study greatly depends on two risk fac- 
tors of our hybrid design: 

1. the extent to which PNs are able to detect patients 
who need the self-management support; and 

2. the match between the patients who are detected by 
the researcher-led screening and those detected by 
the PN. 

If PNs in our study would, for any reason, not detect 
or not treat patients who are recruited for the effect 
evaluation on the basis of the researcher-led screening, 
it may become difficult to demonstrate the clinical ef- 
fectiveness of SMS. Nevertheless, the clinical effective- 
ness outcomes of SMS integrated in routine care are 
very important for decisions about future planning and 
(financial) support for SMS. If we are unable to demon- 
strate clinical effectiveness of SMS, the speed of transla- 
tion of the evidence-based intervention into routine care 
may even be threatened due to the methodological is- 
sues of a hybrid effectiveness-implementation design. 
We will try to minimise the risks by providing training 
to PNs, followed by booster sessions, using a formative 
evaluation method that gives us the opportunity to refine 
the detection procedure, and by a researcher-led screening 
that closely resembles the detection at the consultation in 
terms of timing and procedure. 

Abbreviations 

DFT: Daily functioning thermometer; DS: Distress screener; 4DSQ: Four- 
Dimensional Symptom Questionnaire; GP: General practitioner; Hybrid E-l 
design: Hybrid effectiveness-implementation design; MPI: Minimal 
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